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capacitors which apply electric fields to liquid 
crystal material located between the capacitor 
plates. Each capacitor is associated with a 
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acoustically, by pressure, by temperature, or by 
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(54) Input means for liquid crystal display. 

(57) A liquid crystal display includes a plurality of 
capacitors which apply electric fields to liquid 
crystal material located between the capacitor 
plates. Each capacitor is associated with a sen- 
sor which detects the presence of a hand-held 
stylus. The detection can be done optically, 
acoustically, by pressure, by temperature, or by 
other means. 




Q. 

LU 



Jouve, 18, rue Saint-Denis, 75001 PARIS 



1 



EP 0 618 527 A1 



2 



This invention relates to liquid crystal display de- 
vices. Figure 1 illustrates nine pixels of a Liquid-Crys- 
tal Display (LCD). Each box labeled DEVICE repre- 
sents one of the LCD elements. Each LCD element 
is called a pixel. The transistors labeled MOS turn 5 
their respective pixels on and off. 

The operation of the LCD can be explained, in a 
very simplified manner, as follows. In Figure 2, liquid 
crystal material M is contained between the plates P 
of a capacitor C. (Each box labeled "DEVICE" in Fig- 10 
ure 1 contains one of the devices shown in Figure 2.) 
Each plate P in Figure 2 actually takes the form of a 
thin coating of Indium Tin Oxide, ITO, on GLASS, as 
indicated in Figure 3A. Each coating of ITO, in turn, 
bears a coating of polyimide, as indicated in the insert 15 
4. The polyimide has been rubbed, during manufac- 
ture, in a unidirectional manner. The rubbing causes 
the molecules of the liquid crystal material, which are 
adjacent to the polyimide, to align with the direction 
of rubbing. For example, molecules M1 and M2 align 20 
as shown. The polyimide layers are arranged such 
that the aligned molecules M1 and M2 are perpendic- 
ular to each other, as shown. The molecules located 
in the bulk of the liquid crystal try to align themselves 
withMI and M2 ? but, because M1 and M2 are perpen- 25 
dicular, the bulk molecules align into a helix H which 
bridges M1 and M2. 

Polarizing filters are affixed to each sheet of 
GLASS, as indicated. When incoming LIGHT enters, 
as shown in Figure 3B, the polarization of the LIGHT 30 
follows the twisted molecules, and the LIGHT under- 
goes a continuous 90-degree twist, as shown, and ex- 
its through the bottom polarizing filter. The human 
EYE, perceives the pixel as bright, because of the ex- 
iting LIGHT. However, when a small voltage (such as 35 
3-5 volts) is applied between the ITO plates, the vol- 
tage creates an ELECTRIC FIELD in Figure 4, which 
disturbs the gradual twist of the molecules. The helix 
no longer exists. The light is no longer twisted as it 
travels, but is blocked by the lower polarizing fi Iter, as 40 
shown in Figure 5. The pixel appears dark. 

In an actual LCD, the number of pixels is quite 
large. For example, the display of a small computer 
can contain an array of 480 x 640 pixels, giving a total 
of 307,200 pixels. With such a large number of pixels, 45 
the voltage described in connection with Figure 4 is 
applied to each MOS in multiplex fashion. In multi- 
plexing, there exists an external Random-Access 
Memory (termed Video RAM, or V-RAM) which con- 
tains a memory cell for each pixel. A video controller so 
(not shown) writes data, which represents the image 
to be displayed, into the V-RAM. Then, other circuitry 
(notshown) reads each cell in the V-RAM, and applies 
the proper voltage to the corresponding MOS, caus- 
ing each pixel to become bright or dark, as appropri- 55 
ate. The charge which produces the ELECTRIC 
FIELD shown in Figure 4 does not last forever, but dis- 
sipates with time. Consequently, the video display is 



"refreshed" periodically, to restore the charge. In one 
type of refreshing, a controller (indicated in Figure 1) 
reads each memory cell in V-RAM, and applies the 
proper charge to each MOS of each pixel, based on 
the memory cell's contents. 

Figure 1 is somewhat exaggerated for clarity: the 
Metal Oxide Semiconductor Transistors (MOS) ac- 
tually occupy proportionately less space than shown, 
and the DISPLAY occupies greater space. The rea- 
son for giving the DISPLAY element more space is to 
allocate maximum area to the information-producing 
component, namely, the DISPLAY element. LCD dis- 
plays are becoming widely used, especially in port- 
able computers having pen-type input devices (which 
augment, or substitute for, keyboard input). 

It is an object of the present invention to provide 
a liquid crystal display advice adapted for versatile in- 
put operation. 

Therefore, according to the present invention, 
there is provided a liquid crystal display device includ- 
ing a plurality of pixels, characterized by a plurality of 
sensor devices, adapted to sense the presence of a 
hand-held stylus and associated with respective pix- 
els, and a plurality of sense lines adapted to carry sig- 
nals produced by said sensor devices. 

It will be appreciated that by providing, in a liquid 
digital display device according to the invention, a 
plurality of sensor devices associated with respective 
pixels and a plurality of sensor lines, versatile input 
operating modes for the device are possible. 

Embodiments of the present invention will now 
be described by way of example, with reference to the 
accompanying drawings, in which:- 

Figure 1 illustrates a nine-element liquid-crystal 
display (LCD). 

Figure 2 illustrates a single element of the LCD. 

Figure 3A illustrates a liquid crystal pixel. 

Figure 3B illustrates light being twisted by the 
pixel of Figure 3A. 

Figures 4 and 5 illustrates blockage of light 
caused by application of a voltage to the pixel of Fig- 
ure 3A. 

Figure 6 illustrates one form of the invention. 

Figure 7 illustrates a hand-held STYLUS deliver- 
ing a signal to the SENSOR of Figure 6. 

Figure 7A is a flow chart illustrating one approach 
to polling the SENSORs of Figure 6. 

Figure 8 illustrates a photodiode used as a SEN- 
SOR. This photodiode can respond to light, or to tem- 
perature. 

Figure 9 illustrates one type of Hall-effect SEN- 
SOR. 

Figure 10 illustrates a magnetoresistive SEN- 
SOR. 

Figure 11 illustrates a MAGFET Hall-effect SEN- 
SOR. 

Figure 12 illustrates a Poly Vinyl DiFluoride 
(PVDF) film used as a SENSOR. 
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Figure 1 3 illustrates a crossing point CP of traces 
T1 and T2 on the PVDFfilm. 

Figure 14 illustrates a STYLUS making a depres- 
sion DD at the crossing point CP of Figure 13. 

Figure 15 illustrates a voltage developed by the 5 
depression DD of Figure 14. 

Figure 16 illustrates an acoustic wave W being 
transmitted by the STYLUS into the PVDF film. 

Figure 17 illustrates a manually powered acous- 
tic signal generator w 

Figure 1 7A illustrates a bent, flat spring, which 
produces an acoustic signal when deformed. 

Figure 18 illustrates a STYLUS having multiple 
oscillators 73. 

Figure 1 8A illustrates a SUMMER for adding the 15 
oscillator signals of Figure 18. 

Figure 1 9 illustrates a PVDF sheet containing liq- 
uid crystal droplets. 

Figure 20 illustrates use of the STYLUS to pro- 
duce color signal input. 20 

Figure 21 illustrates different types of actuators 
for the DEVICES of Figure 1 . These different types 
can replace the MOSs in Figure 1. 

Figure 6 illustrates a 3 x 3 array of pixels. A SEN- 
SOR is associated with each pixel. Associated with 25 
each column of pixels is a SENSE LINE. Each SEN- 
SOR in the column connects to the column's SENSE 
LINE. When a user wishes to actuate a pixel, the user 
brings a hand-held input device, or STYLUS, adjacent 
the desired pixel, as shown in Figure 7. The stylus 30 
produces a STYLUS SIGNAL, which is detected by 
the SENSOR. The sensor produces a sense signal on 
the SENSE LINE. 

One approach for detecting the STYLUS SIG- 
NALS is the following. As shown in Figure 7, switch 35 
SW1 of a ROW DECODER and switch SW2 of the 
SENSE LINE are both closed. Any signal produced by 
SENSOR (1,1) can now be detected by DETECTOR 
D. If SENSOR (1,1) indicates that a STYLUS SIGNAL 
is being received, the DETECTOR D responds, and 40 
produces a signal on line 25. The V-RAM SYSTEM 27 
stores this signal in V-RAM at the location corre- 
sponding to the address of SENSOR (1,1). The V- 
RAM SYSTEM then interrogates SENSOR (1,2), by 
opening switch SW2 and closing switch SW3. SEN- 45 
SOR (1,2) is read and its signal stored in V-RAM. The 
operation proceeds until all SENSORs have been in- 
terrogated, and all PIXEL CELLS refreshed. Next, the 
V-RAM SYSTEM interrogates all memory cells in V- 
RAM, and applies charge to the corresponding 50 
MOS's, as appropriate, to brighten or darken each 
pixel. Then, the process of polling each SENSOR re- 
peats, followed by refreshing. 

Figure 7Ais a flow chart illustrating the polling/re- 
fresh cycle, but slightly modified from the procedure 55 
just outlined. In the flow chart, refreshing is done for 
each pixel cell immediately after reading the SEN- 
SOR associated with each cell. This reading and re- 



freshing process is quite rapid. An entire screen of 
480 x 600 pixels (307,200 pixels total) is refreshed ev- 
ery 0.005 second, or so. This rate is very fast, com- 
pared with normal motion of the human hand, so that 
even if the STYLUS in Figure 7 is moving, it will dwell 
long enough over each SENSOR to allow detection of 
the STYLUS SIGNAL. 

Numerous combinations of SENSOR and STY- 
LUS are possible. One combination is a photosensor, 
such as a PHOTODIODE, shown in Figure 8. Other 
types of photosensor can used, such as phototransis- 
tors, or photo-field-effect transistors (neither is 
shown). With this combination, radiation, in the form 
of light, is the STYLUS SIGNAL. The photosensor 
produces a change in voltage, between points A and 
B, in response to the light. 

Alternatively, the signal produced can be dark- 
ness. That is, in this case, all SENSORS ordinarily 
produce signals in response to ambient light The 
STYLUS is passive, and produces a shadow, by 
eclipsing the ambient light The shadow causes the 
shadowed SENSORs to produce different signals 
than those exposed to ambient light. This type of com- 
bination is perhaps best for small LCD displays. In a 
large display, the heel of the user's hand (which holds 
the STYLUS) will probably rest partly on the display 
and cause shadowing itself. In a small display, this 
type of shadowing will not occur. 

A Hall-effect SENSOR can be used. In this case, 
the signal produced by the stylus will be a magnetic 
signal. One type of Hall-effect sensor, known in the 
prior art, is shown in Figure 9. With no magnetic field 
applied by the stylus, current flows through the Hall 
region, as though flowing through a normal resistor. 
However, when a magnetic field is applied, a Hall vol- 
tage is produced, which produces a voltage between 
the collector C and base B of transistor Q1. The ac- 
tuation of Q1 is detected by the remaining transistors. 
The magnetic field is produced by coil CC contained 
within the STYLUS. The coil CC is powered by a bat- 
tery BB. It is known in the prior art how to construct 
such a HALL REGION of size 250 x 250 (1 0 x 1 0 mi Is). 

A magnetoresistive sensor can be used. In this 
case, the signal produced by the stylus is magnetic. 
The magnetic signal is detected by a magnetoresis- 
tive material. There are two major classes of magne- 
toresistive material. In one, a magnetic field (not 
shown) forces the current to traverse a longer path 
than it would ordinarily. Figure 1 0 indicates this longer 
CURRENT PATH. The magnetic field is perpendicular 
to the plane of the Figure. The longer path produces 
a larger voltage drop between points A and B, which 
is detected. Magnetoresistive sensors are known in 
the art. Asecond class of sensor does not utilize a lon- 
ger current path, but relies on giant magneto-resistive 
molecules. The SENSOR in Figure 10 is constructed 
using these molecules. A magnetic field distorts the 
molecules, causing a change in resistance, which is 
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detected in a customary manner. 

Hal! contacts can be added to a large-channel, 
enhancement-mode, MOSFET having large channel 
dimensions, and which is operated in either pinch-off 
or triode mode. One example is shown in Figure 11. s 
Such MOSFETs are called MAGFETs, and are known 
in the art A magnetic stylus is used. 

A transparent poly vinyl difluoride (PVDF) film 
can be attached to the glass, as shown in Figure 12. 
One supplier of such film is Pennwalt Corporation, lo- 10 
cated in King of Prussia, Pennsylvania, which sells 
the film under the generic name "piezoelectric film" 
and the trade name KYNAR. The PVDF film contains 
signal traces T. Horizontal traces T1 are located on 
the bottom of the film; vertical traces 12 are located 1 5 
on the top. The crossing points CP are positioned be- 
neath respective PIXEL CELLs, as indicated. Figure 
1 3 shows an enlarged view of a crossing point. When 
the stylus presses upon the PVDF film, it creates a 
depression D, as shown in Figure 14. The depression 20 
causes a voltage to arise between points F and G in 
Figure 15, This voltage is detected on the traces T1 
and T2, by a detector such as D in Figure 7. The PVDF 
film is a type of strain gauge, albeit distributed uni- 
formly across the LCD display. Alternately, conven- 25 
tional strain gauges can be used, one at each cross- 
ing point CP in Figures 12 and 13. 

The STYLUS can be active; it can produce an 
acoustic signal, indicated by sound waves W in Figure 
16. The sound waves, upon entering the PVDF film, 30 
cause compressions and ran factions, which produce 
detectable voltages. To produce the sound, the STY- 
LUS can contain a transducer, such as a piezo-elec- 
tric speaker, and an electrical oscillator, which cause 
the tip of the STYLUS to vibrate. An oscillator requires 35 
a power supply, such as a battery, and this require- 
ment can be disadvantageous. To eliminate a power 
supply, the acoustic signal can be produced by ener- 
gy supplied by the human user of the STYLUS. For 
example, as shown in Figure 17, the STYLUS con- 40 
tains a hammer 50. When the user's finger (not 
shown) puils a trigger 53, the trigger 53 pulls the ham- 
mer 50 back until a pin 56 disengages the hammer 50 
from the pin, via cam 58. Upon disengagement, a 
spring 59 drives the hammer 50 into contact with the 45 
tip of the STYLUS, producing a sound 62. The sound 
62 causes compression and decompression in the 
PVDF film in Figure 16, producing a signal on traces 
T1 and T2. 

There are numerous other ways of producing an 50 
acoustic signal, or clicking sound, based on motion of 
a finger. For example, a flat leaf spring S in Figure 
17A, having a slightly C-shaped cross section, will 
produce a "click" when bent. Similarly, a steel dia- 
phragm (not shown) having a bulge formed into it (re- 55 
sembling the bottom of an oilcan) produces a "click" 
when deformed. Other types of finger-operated 
noise-makers are known. 



The acoustic signal must persist long enough for 
the refresh circuitry to detect it. That is, the acoustic 
signal should last longer than one refresh cycle. (If the 
acoustic signal lasted, for example, 1/5 of a refresh 
cycle, it could disappear before the SENSOR detect- 
ing the signal were polled.) To produce a signal of lon- 
ger duration, the trigger mechanism of Figure 17 can 
pluck a string or tuning fork, producing a sustained 
note which excites the PVDF film. 

The STYLUS can contain multiple oscillators 73, 
each operating at a different frequency, as shown in 
Figure 1 8. Each crossing point CP (also shown in Fig- 
ure 13) acts as a transducer which responds to all os- 
cillators. A DISCRIMINATOR detects which signal 
was sent. As an example, the STYLUS has four but- 
tons B1 - B4, which actuate switches, and which pro- 
duce one of the following frequencies: 1 KHz, 2 KHz, 
3 KHz, or 4 KHz. The crossing point CP produces a 
time-varying voltage at the frequency received. The 
DISCRIMINATOR can comprise four LM 567 integrat- 
ed circuits, as indicated. Each 567 is tuned to one of 
the STYLUS'S frequencies. Thus, if the STYLUS pro- 
duces a signal of 2 KHz, line 75 produces a signal. If 
the STYLUS produces a signal of 4 KHz, line 77 pro- 
duces a signal. The different signals can be used to 
draw lines of different color. For example, one fre- 
quency can call for red color. Another for blue color, 
and so on. This type of STYLUS can be used with the 
color V-RAMs described later. 

More than one frequency can be produced by the 
STYLUS simultaneously. In this case, the oscilla- 
tors' outputs 01 - 04 are added in a SUMMER in Fig- 
ure 18A, which feeds the transducer TRANS, per- 
haps through an amplifier (not shown). The 567's re- 
spond as usual. Now, a four-bit binary word is trans- 
mitted by the STYLUS. 

Thin sheets of material, in the range of 25 mi- 
crons (one mil) thick, are available which contain en- 
capsulated drops of liquid crystal material. One sup- 
plier is Raychem Corporation, located in Menlo Park, 
California. This material is known as "Polymer Dis- 
persed Liquid Crystal" (PDLC) or "Nematic Curvili- 
near Aligned Phase" (NCAP) film material. Such ma- 
terials can be used as the LCD display. Alternatively, 
as shown in Figure 19, this sheet material can be con- 
structed of PVDF. When the STYLUS is applied to the 
sheet, it produces a voltage detected by the TERMI- 
NALS, as indicated by the + and - symbols at the lower 
right part of the Figure. This voltage is detected and 
stored in V-RAM, as described above Transparent ca- 
pacitors CC, of very thin metal, form the PIXEL ELE- 
MENTS. A voltage applied to the capacitor CC will 
darken the PIXEL CELL, as described above. The 
connectors are not shown in Figure 19, for simplicity. 

The SENSORs can be temperature-sensitive. 
One such SENSOR Is the P-N diode. The current-vol- 
tage expression for such a diode is the following: 
I = l 0 [exp(qV/kT) - 1] 



4 



7 



EP 0 618 527 A1 



8 



temperature changes. 

A device according to claim 1, characterized in 
that said sensor devices are adapted to detect 
mechanical deformation. 

A device according to claim 5, characterized in 
that said sensor devices include respect strain 
gauges. 

A device according to claim 5, characterized in 
that said sensor devices include piezo-electric 
material. 

A device according to claim 1, characterized in 
that a plurality of colour select means (80, 82, 84) 
are provided, in that said sensor devices are cou- 
pled to said colour select means (80, 82, 84), and 
in that said pixels each include a plurality of indi- 
vidual pixel elements associated with repective 
colours to be displayed, 
or a combination, of the three COLOR SELECT IN- 
PUTS, R (red), G (green), or B (blue). The AND-gates 
80, 82, and 84 accordingly deliver the signal produced 
by the SENSOR to the respective column registers. 25 
For example, if the user selects R and B, then lines 
SR and SB deliver signals to the column registers of 
the V-RAM. Each pixel has associated three capaci- 
tors, for the three colors, namely, R, G, and B, as in- 
dicated. 30 

The pixels need not be activated by the MOS 
transistors indicated in Figure 1 . Other approaches to 
actuation are shown in Figure 21. These are known 
in the art. MIM refers to Metal-Insulator-Metal struc- 
tures, such as Chrome-Tantalum pentoxide-Tanta- 35 
lum. BTB refers to back-to-back diodes. TFT refers to 
Thin Film Transistors. 



Claims 40 

1. A liquid crystal display device including a plurality 
of pixels, characterized by a plurality of sensor 
devices, adapted to sense the presence of a 
hand-held stylus and associated with respective 45 
pixels, and a plurality of sense lines adapted to 
carry signals produced by said sensor devices. 

2. A device according to claim 1, characterized in 

that said sensor devices are adapted to detect 50 
light. 

3. A device according to claim 1, characterized in 
that said sensor devices are adapted to detect 
magnetic fields. 55 

4. A device according to claim 1, characterized in 
that siad sensor devices are adapted to detect 



wherein 

l 0 is reverse saturation current 

q is the charge on the electron 5. 

V is the voltage across the junction 

k is Boltzmann's constant 5 

T is temperature, degrees Kelvin. 
If current is held constant, then the voltage is pro- 6. 
portional to temperature of the diode. The voltage V 
changes by about 2 millivolts for each degree C 
change in temperature, provided current I is held con- w 
stant. Thus, the P-N diode of Figure 8 can be used. 7. 
The STYLUS contains a source of heat, such as a las- 
er diode, or an infrared light source. A bipolar junction 
transistor can also be used as the SENSOR: it con- 
tains two diodes: one at the base-collector junction, 15 8. 
and the other at the base-emitter junction. The cur- 
rent fed to the diode must be held constant, as stated 
above. Constant current sources are known in the art. 

Figure 20 shows how the SENSOR can be used 
to provide data indicative of the desired color of a pix- 20 
el, in addition to position data. A user actuates one, 
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